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Executive Summary 



Inventory managers are faced with the difficult problem of making 
decisions under the uncertainty of future needs. This problem is espec- 
ially critical in the Navy where such important decisions as those con- 
cerning budgets, the range and depth of stock to be maintained and when 
to replenish stocks must all be made for hundreds of thousands of items 
on the basis of predictions about future demand. In order to provide a 
margin of safety to protect against random fluctuations, the inventory 
manager needs to make a probabilistic statement about the demand process 
for each item. But, because of the size of the Navy’s inventory system, 
it is not feasible to give individual attention to determine "optimal ’ 1 
forecasts for each item. Consequently, the Navy has attempted to solve 
the forecasting problem by assuming a family (or families) of probability 
distributions and concentrating on the problem of estimating the parameters 
for the individual items. Several investigations have looked into the 
problem of how to estimate the parameters. In this report we focus atten- 
tion on the problem of selecting an appropriate family of probability dis- 
t ribut ions . 

Various decision criteria should be considered when selecting a 
family of distributions to describe demand. The family must be rich 
enough to be able to describe demand distributions for a large number of 
different items, and it must be mathematically tractable. Furthermore, 
the family should reflect the current knowledge of the characteristics of 
the demand, but, at the same time, it should also reflect the uncertainty. 
These considerations combined with previous experience with demand data 
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and knowledge about the type of information available to the inventory 
manager led us to examine the family of gamma distributions. 

Using the maximum entropy procedure, a decision criterion which 
leads one to select that family which maximizes the decision maker f s un- 
certainty subject to his current information, we show that the gamma family 
results from information typically available to inventory managers. In 
addition, we used actual demand data to compare the gamma family to the 
normal family, which is currently employed almost exclusively in the Navy’s 
forecasting procedures. Goodness-of -f it tests were performed and numeri- 
cal evaluations of various measures of supply effectiveness were made. 

The experimental evidence gives strong support for the use of the gamma 
family as preferable to the normal family for describing demand. 
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1. 1 nt rod net i on 

Large multi-item inventory systems have long been confronted with 
the problem of forecasting the occurrence of future demand. The stochas- 
tic nature of demand creates an uncertainty that has a significant impact 
on virtually every decision that an inventory manager must make. For 
example, such inventory decisions as 

(1) what items should be stocked, 

(2) at what depth should an item be stocked, 

(3) how should budgets be allocated among items, 

(4) when should resupply orders be placed, and 

(5) how much should be ordered 

all depend strongly on the forecasts of future demand. In order to provide 
a high level of service to the customer, the inventory manager must protect 
against stockouts as best possible within his limited resources. This Can 
only he done by anticipating future demand. 

In those cases where inventory levels are updated continuously and 
orders can be placed as soon as available stock reaches the reorder level, 
the time lag between the moment the order is placed and the time the order 
is received is an interval of uncertainty. Without incurring extra costs, 
the inventory manager is at the mercy of his customers and his supplier 
during the procurement lead time. He can only attempt to protect the in- 
ventory system against stockouts during those intervals of uncertainty by 
placing orders before the stock assets drop too low. Since he can nevei 
be certain that his on-hand stock will last throughout the lead time, he 
will usually assume that future demand will be similar to the past demand. 
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He will then estimate the probability distribution of lead time demand to 

guide him in making his decisions. 

Nearly all mathematical models, from the very naive to the most 

sophisticated, require the probability distribution of lead time demand. 

For example, if F^(*) represents the cumulative distribution of lead 

time demand for item i and r. is the reorder level for item i , al- 

1 

most all models dictate, in some form, that the reorder level be determined 
by solving 



1 " F i (r i } = C i (1) 

The value depends on the model; it is usually a function of the in- 

ventory costs or some specified measure of system performance. We are 
concerned with the problem of selecting an appropriate probability distri- 
bution F^( # ) . 

Because of the sheer magnitude of large multi-item inventory sys- 
tems, the inventory manager can rarely afford the luxury of examining 
the demand histories of the items individually and fitting the "best 11 
distribution to each item. For the most part the data required for such 
an analysis is unavailable. Even if the data were available the dynamic 
nature of demand histories would make a simple distribution-fitting ap- 
proach of limited value. These problems notwithstanding a cost/benefit 
analysis would probably suggest that some alternative method be employed. 
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2 - Se lectin^ A Family of Distributions 

One feasible way to accomplish the task is to select a family of 
probability distributions in some rational manner. Given an individual 
item, a particular member of the chosen family would be selected by esti- 
mating the necessary parameters using statistics collected from the item's 
demand data. This approach is particularly attractive because of its com- 
putational simplicity. Fndeed, most large inventory systems have taken 
this approach. However, it is evident from the bulk of the forecasting 
literature (see, for example, Brown 1 ', Harrison \ and Winters 8 ) that most 
attention has focused on the problem oi estimating the parameters of the 
distribution. When placed in the proper perspective, it is hard to justify 
the use of a costly sophisticated forecast technique to estimate parameters 
for a poorly chosen family of probability distributions. 

What is the appropriate family of distributions? Falling back on 
first principles, it can be argued in many cases that a Poisson process or 
a compound Poisson process generates demands. Nevertheless, the lead time 
itself may be a random variable so that the marginal distribution of lead 
time demand can easily become intractable even if the process generating 
demands were relatively simple like a compound Poisson process. What is 
needed is a simple distribution which lends itself easily to numerical cal- 
culations and which provides a good approximation in practical applications. 

The quest for such a family of approximating distributions has led, 
in most cases, to the choice of a family of distributions for continous 
variables despite the fact that demands are normally integer valued. This 
is because it is usually easier to work analytically with variables that 
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can be treated as continuous. Any problems caused by using a continuous 
distribution to approximate a discrete distribution can usually be ignored. 
The most frequently used family of distributions has been the normal family. 
The advocates of the normal family will support their choice by arguing 
that it is easy to work with and well tabulated. For theoretical support 
they will then make some appeal to the Central Limit Theorem to argue for 
the normality of leadtime demand. These arguments certainly support the 
choice of the normal family, but is that really the best family to use? 

The normal distribution has one obvious shortcoming — it does not have the 
proper domain for the inventory application. This may not be serious if 
the weight assigned to the negative half of the real line is small, but 
problems could arise if that weight is not negligible. A simple way to 
correct that deficiency is to truncate the left tail of the normal distri- 
bution at zero and normalize the resulting truncated distribution. We are 
then led in a natural way to consider the family of truncated normal dis- 
tributions. This is certainly appealing, but a stronger justification is 
needed for selecting any family to be used. We must establish reasonable 
decision criteria upon which to base our choir. of a family of distributions. 
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3. Maximum Entropy Criterion 



The problem confronting the inventory manager is to select a proba- 
bility distribution for the lead time demand given only limited knowledge 
about the random nature of the process. An appealing criterion which is 
often used to make such a decision is that of maximizing the entropy. 

The inspiration for the method of maximum entropy is due to the 
work of Shannon and Weaver^ in communication theory. The entropy of a 
probability function is defined to be the expectation of the logarithm of 
the probability function. Mathematically, if f(x) is the probability 
density function associated with the continuous random variable X de- 
fined on the interval (a,b) , the entropy of the probability function 

Is given by 



b 

H(f) = - | f(x) £n f(x)dx (2) 

a 

The entropy is taken as a measure of the amount of "uncertainty" contained 
in the distribution of X . The inventory manager usually has some know- 
ledge of the characteristics of the random variable X through past his- 
tory, his experience with the customers or perhaps known moments. His 
problem may then be viewed as one of finding a probability density 
f(x) that maximizes the entropy subject to constraints that reflect the 
current knowledge of the characteristics of the random variable. Formally, 
the inventory manager wishes to 



max H(f) 
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subject to 



b 

| f (x) dx = 1 (3) 

a 

b 

| £ k (x)f(x)dx = , k = 1 ,2 , . . . ,n 

a 

f(x) ^ 0 , a x * b 

where is a constant for a given function * For example, if 

k 

C^(x) = x , p^ is t ^ le kth moment. 

Introducing Lagrange multipliers ot,A^,...,A^ , we convert (3) to 
the following: 



b 

max 4>(x,f(x)) = - ( [ ^n f(x) + a 4- £ A f (x)]f(x)dx 

J k=l ^ k 

a 



+ a + 



k=l 



Vk 



(4) 



It follows from the calculus of variations that 4>(x,f(x)) is maximum 
when 



3 

3f (x) 



Un 



f (x) + a + 



n 

l A k ^(x)}f(x) 



= 0 



This leads to the general maximum entropy density 
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( 5 ) 



n 

f(x) = exp(- } A f (x)) , a £ x £ b 

k~0 

where A^ = 1 + a and we take £q(x) = 1 • The n + 1 constraint equa- 
tions in (3) must be solved in order to determine A^,A^,...,A n in (3). 
The method of maximum entropy yields many of the classical probability 
density functions under appropriate conditions. Some of the results are 
summarized in Table 1. 



Table 1. 



Some Classical Maximum Entropy Densities 



Conditions 


Density Function: f(x) 


q(x) = o 


UNIFORM 1/ (b-a) 


a *" x b 




^(x) = X 


EXPONENTIAL X exp(->x) 


x 6 (0 ,°°) 


A > 0 


^(x) = X 

T 9 (x) = Hn x 
x € (0 1 °°) 


GAMMA x ( a ~ ^exp ( -x / 3 ) 
r (a) g a 

a ; 3 > 0 


^(x) = X 

5 2 (x) = x 2 
x t (0 ,°°) 


TRUNCATED , , , 2 /o 2 a 

NORMAL - 

a /2 tt 

K > 0 , o 2 • 0 


^(x) = X 

5 2 (x) = X 2 


Normal exp(-(x-p) 2 /2a 2 ) 

a </ 2 t \ 


x £ (- 00 ,°°) 


a 2 0 



It is intuitively appealing that classical probability densities 
result from the maximum entropy method with the specification of simple 
moments. For the inventory problem the distributions of interest are 
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exponential, gamma and truncated normal. 

The appropriate discrete analogs for the densities and conditions 
given in Table 1 follow directly. The details leading to this table as 
well as the details for other maximum entropy densities are found in the 
works by Tribus r ’ and Clough 2 . Although the concept of maximizing entropy 
as a criterion for decision processes has only recently received wide ac- 
ceptance in engineering, psychology and business and economic applications, 
it has long been known as a tool for statistical inference. For a rigor- 
ous mathematical treatment of this, the reader is directed to the work 
of Kullback 4 . 
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4. Other Decision Criteria 



Under appropriate conditions (see Table 1) the exponential, trun- 
cated normal and gamma were all seen to be maximum entropy distributions 
over the interval (0,°°) . In the inventory problem the above moments 

may not be known, but estimates can probably be obtained by examining past 
demand data. It is the decision-maker’s prerogative to collect whatever data 
he deems useful. Those statistics typically include estimates tor only 
the mean and variance, but it would be a simple task to collect an esti- 
mate for other moments such as Eftfn x] . The maximum entropy distribution 
depends on the information that is available. Therefore, we are faced with 
another decision — what information should be collected? 

The information that is collected should result in a family of maxi- 
mum entropy distributions which is versatile (allowing for many shapes) 
and mathematically tractable. More importantly, the resulting family should 
perform well in view of the measures of supply effectiveness. For example, 
if the objective of the inventory system is to minimize the total number 
oi stockouts subject to a given investment in stock, one should prefer that 
family which yields the fewest stockouts with a given inventory investment. 
Other measures of effectiveness such as the probability of a stockout or 
time-weighted backorders might also be appropriate as decision criteria 
for selecting among families of distributions. 

The gamma family of distributions becomes particularly attractive 
when one considers its versatility and t ract ab ility . This two parameter 
family is so rich that it can approximate virtually any nonnegative uni- 
modal distribution. In fact, many of the classical distributions such as 
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the exponential, chi-square and the Kriang ur< special cases of the gamma 
family Furthermore, a member of Lhis family can usually be found Lliat 
provides a good approximation to such distributions as the Weibull , log 
normal and the truncated normal (having domain (0, )). These facts, 
combined with the knowledge that it is a maximum entropy distribution, 
weigh heavily toward the selection of the gamma family. However, the 
crucial test is how well the inventory svstem performs in actual use with 
the g amma f am i ly . 
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5 . Da ta Comparisons: Gamma vs. Normal 



We have previously commented that the normal family enjoys wide- 
spread use in the inventory community for describing the distribution of 
lead time demand. We have presented supporting arguments for using the 
gamma family. We now seek to make the case for the gamma family even 
stronger by presenting a posteriori comparisons with the normal family 
using actual demand data. The comparisons reveal which family gives the 
better "fits" as well as which family does the better job of maximizing 
the effectiveness of the inventory system. 

In order to compare the normal and gamma families, a random sample 
of 50 items was selected from a data base of 1000 items in the inventory 
of the United States Air Force. For each item there were 57 observations 
of lead time demand. The first test examined the ’‘goodness of fit' 1 pro- 
vided by the rormal and gamma families. Next, the stockout risks were 
examined. Finally, the two families were compared in an aggregate manner 
using the average overall system risk per dollar of stockage cost as a 
measure of effectiveness. 

5 . 1 Tests of Goodness of Fit 

For each item, estimates of the mean p , the variance a ^ and 
E[in X] were calculated as follows: 
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1 



n 



n 



i = 1 



x . = x 
1 



2 




(x --x) ; ' = S 



(6) 




1 



n 

V n fl x . = in x 



E[J6n X 



n 



i«l 1 



Using the gamma density f(x;a,3) given in Table 1, a particular member 
was selected for each item by determining the parameter pair (u,3) bv the 
method of moments. That procedure gives the following estimates: 



where ip ( ot) = d in l’(a)/d a is the digamma i unction. Similarly, the nor- 



the normal family. The Kolmogorov-Smi mov test was then applied for each 
of the 50 items to test first the hypothesis 

: The data are from the selected normal distribution, 

and then the hypothesis 

H^: The data are from the selected gamma distribution. 

The tests were conducted at a significance level of .10 with the results 
as summarized in Table 2. 



ip(a) - £n a = In x - Jin x 



(7) 



3 = x/a 



mal distribution with parameters p = x and o 



2 



S was selected from 
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Table 2. 



K-S Test Results 



Dist ribution 


Times 


Times 


Accept ance 


Accepted 


Re j ected 


Percentage 


Normal 


0 


50 


0% 


Gamma 


31 


19 


62% 



The goodness-of-f it tests, alone, present a strong argument in favor 
of the gamma family. Whereas the normal family never provided a suffi- 
ciently good fit, the gamma family gave a satisfactory fit in 62% of the 
cases. Furthermore, the gamma beat the normal in all cases (using the K-S 
statistic as the test criterion), 

5 a 2 Stockout Risks 

As discussed earlier, a probability distribution for lead time demand 
is used primarily to determine reorder levels. The higher the reorder 
level r^ , the lower will be the probability that the lead time demand 
will exceed r^ . Define the stockout risk to be this probability. One 
cost-independent method of determining the reorder level is to specify a 
value for the risk which is acceptable, say , and solve (1) for r^ 

with C_^ = p_^ . Since F (•) is really unknown, the actual risk may 
differ from the desired risk. The better the distribution F.(*) approx- 

i 

imates the true underlying distribution, the smaller will be the difference 

between the actual and desired values for stockout risk. 

A second comparison of the two families was undertaken to determine 

how well each performed in determining reorder levels. With a selected 

value of p. = 0.20 , the actual empirical distribution F ( 6 ) for each 
i h 

item was used to determine the reorder level from (1). (The actual risks 
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were slightly less than 0.20 because the reorder levels were rounded to 

the next higher integer.) In the same manner, both the normal and the 

gamma distributions, F^(-) and F^(-) , were substituted into (1) to 

determine r and r respectively. These values were then used with 
N G 

the empirical distribution to estimate the actual risks yielded by the 
normal and gamma families. That is, the values 



and (8) 

D C ‘ 1 ' F E (r G ) 

were determined. For example, if F (10) = 0.75 , F (15) = 0.80 and 

E E 

F (20) = 0.90 , then the reorder level should be 15 to get a risk of 
E 

0.20 . Now, if r = 20 and r = 10 , then the actual risks are 

N G 

P N = 0-10 and = .25 . 

In general, these comparisons revealed that the actual risks given 
by the gamma family were closer to the desired levels than were those ob- 
tained from the normal family. The reorder levels determined from the 
normal family tended to overprotect against stockouts; that is, the values 
of r^ were usually much higher than those needed to give the desired 
protection. Three typical comparisons are illustrated in Table 3. 



Table 3. 

Comparison of Risks (p = 0.20) 



Dist ribut ion 


Item 1 


Item 2 


Item 3 


r 


Risk 


r 


Risk 


r 


Risk 


Empirical 


4 


.193 


22 


.176 


171 


.193 


Gamma 


4 


.193 


26 


.142 


181 


.175 


Normal 


10 


.090 


28 


.123 


368 


.070 
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Judging the two families on the basis of how close the reorder 
levels r^ and r^ are to the reorder levels determined by the empirical 
distributions, the gamma family showed to be superior to the normal family. 

5 . 3 System Synthesis: Average Stockout Risk per Dollar 

The comparison of stockout risks revealed that the normal family 
tended to overprotect against stockouts. While it is desirable to reduce 
the stockout risks as low as possible, this cannot be accomplished without 
paying the price of carrying larger safety stocks. For example. Table 3 
shows that the reorder level for item 3 as calculated by the normal dis- 
tribution to give a risk of 0.20 was 368 when a level of 171 would have 
been sufficient. The inventory system would certainly provide better ser- 
vice (in terms of reduced stockouts) with the higher reorder level, but 
it must pay for that extra performance through higher investment and 
holding costs. With the limited budgets of large multi-item inventory 
systems, such excesses cannot generally be tolerated. When one item is 
given too great a protection in a system with limited resources, the risks 
for other items must increase. 

The final comparison looked at overall system risk by synthesizing 
the operation of the inventory system (50 items) for 57 months with actual 
demand data using reorder levels determined in one case by the normal family 
and then repeated using the gamma family. A startup period of 21 months 
was used to give initial estimates of the parameters of the demand distri- 
butions. Those parameters, and consequently the reorder levels, were up- 
dated continually as more data became available. Assuming a holding cost 
rate of one per cent per month, total holding costs were accumulated. 
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The fraction of those lead times in which the lead time demand exceeded 
the reorder level (stockouts occurred) was used to estimate "total system 
risk." The system syntheses were repeated for different values of p 
with results as depicted in Figure 1. 



SYSTEM 

RISK 




FIGURE 1 
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One observes from Figure 1 that, for any fixed value of total holding 
cost, the gamma family gave a system risk lower than that given by the 
normal family. Hence, use of the gamma family appears to be the more 
cost -effect ive alternative . 
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6. Conclusions 



We have presented intuitive and theoretical arguments for using the 
gamma family to describe the distribution of lead time demand. We have 
also attempted to evaluate the gamma family as compared to the normal 
family, which is a widely used competitor. Three reasonable decision 
criteria based on measures of inventory effectiveness were used in those 
comparisons. The tests were conducted with a given set of real world de- 
mand data. 

One may certainly argue that the numerical comparisons might not 
have favored the gamma family so strongly with a different set of actual 
demand data. Perhaps special characteristics of the processes generating 
demands in a given inventory system could be described better with the 
normal family or some other family. 

Nevertheless, we have shown with the available data that the gamma 
family easily out performs the normal family with respect to (1) goodness 
of fit, (2) the determination of reorder levels and (3) total system risk 
per dollar of holding cost. 



21 



References 



1. Brown, R. G. , Smoothing, Forecasting and Prediction , Prentice-Hall 
Inc., Englewood Cliffs, N.J., 1963. 

2. Clough, D. J., "Application of the Principle of Maximum Entropy in 
the Formulation of Hypotheses , M Canadia n Operations Research Society 
Journal , Vol. 2, Dec. 1964, pp. 33-70. 

3. Harrison, P. J., "Exponential Smoothing and Short-term Sales Fore- 
casting," Management Science , Vol. 13, No. 11, July 1967. 

4. Kullback, S., Information Theory and Statistics , Dover Publications, 

New York, 1968. 

3. Shannon, C. E. and W. Weaver, The Mathematical Theory of Communications , 
Univ. of Illinois Press, Urbana, 1969. 

6. Tribus, M. , Ra t ional Descriptions , Decisions and Designs, Pergammon 
Press, New York, 1969. 

7o , "The Use of Entropy in Hypothesis Testing," Proceedings 

of the Tenth National Symposium on Reliability and Quality Control , 
Washington, D. C. , Jan. 1964, pp . 579-590. 

8. Winters, P. R. , "Forecasting Sales by Exponentially Weighted Moving 
Averages," Management Science , Vol. 6, No. 3, April 1960, pp . 324-342. 



22 



INITIAL DISTRIBUTION LIST 



No . 



Defense Documentation Center (DDC) 

Cameron Station 

Alexandria, Virginia 22314 

Dean of Research 
Code 023 

Naval Postgraduate School 
Monterey, California 93940 

Library (Code 0212) 

Naval Postgraduate School 
Monterey, California 93940 

Library (Code 55) 

Naval Postgraduate School 
Monterey, California 93940 

Mr. James W. Pritchard 
Code NSUP-01A 

Naval Supply Systems Command 
Department of the Navy 
Washington, D. C. 20390 

Dr. J. W. Hatchett 
Code NSUP-04511F 
Naval Supply Systems Command 
Washington, D. C. 20390 

Mr. Herbert J. Lieberman 
SUr U1A1B 

Naval Supply Systems Command 
Washington, D. C. 20390 

Director, Code 97 

Fleet Material Support Office 

Mechanicsburg , Pennsylvania 17055 

CDR Philip F. McNall (Code 94) 

Fleet Material Support Office 
Mechanicsburg, Pennsylvania 17055 

Dr. Thomas Varley 
Code 434 

Office of Naval Research 
Arlington, Virginia 22217 



Copies 

12 

1 

2 

2 

1 

1 

2 

1 

1 

1 



23 



1 



Hr. Marvin Denicoff 
Code 437 

Office of Naval Research 
Arlington, Virginia 22217 

Mr. B. B. Rosenman 1 

Chief, AMC Inventory Research Office 
Frankford Arsenal 

Philadelphia, Pennsylvania 19137 

Professor K. T. Wallenius 1 

Department of Mathematical Sciences 

Clemson University 

Clemson, South Carolina 29631 

Professor James Chisman 1 

Clemson University 

Clemson, South Carolina 29631 

Professor F. R. Richards 10 

Professor M. U. Thomas 10 

Professor D. A. Schrady 1 

Professor P. W. Zehna 1 

Professor D. P. Gaver 1 

Department of Operations Research 
and Administrative Sciences 
Naval Postgraduate School 
Monterey, California 93940 

Professor Donald Gross 1 

School of Engineering and Applied Science 
The George Washington University 
Washington, D.C. 20006 

Professor Henry Solomon 1 

School of Engineering and Applied Science 
The George Washington University 
Washington, D.C. 20006 



24 



U1 59943 



DUDLEY KNOX LIBRARY - RESEARCH REPORTS 




5 6853 01057969 1 



